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(54) Optimising audio coding through re-encoding 



(57) in a digital audio system, a first audio unit has 
its audio decoder adapted to decode coded digital audio 
data to get coding parameters Including information of 
frame borders of the audio data and release the decod- 
ed digital audio data and coding parameters. A second 
audio unit which receives the digital audio data and cod- 



ing parameters has its audio encoder adapted to re-en- 
code the digital audio data by using the coding param- 
eters. The re-encoding process by use of the best or 
highly optimized coding parameters, which have been 
used for original coding, restores the same state of au- 
dio data, and the reduction of coding errors can be ex- 
pected. 
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Description 

[0001] Tlie present invention relates to an encoding 
and decoding technique of digital audio data, e.g.. a 
tedinique for once decoding coded digital audio data 5 
and thereafter copying and re-encoding the audio data, 
and to a technique which is useful for the alleviation of 
the decay of sound quality of a digital audio system 
which is based on audio encoding and useful for the dig- 
ital radio receiver and audio data delivery service. 
[0002] With the progress of the digital audio technol- 
ogy and the associated data encoding technique, the 
occasion of digital audio data recording and reproduc- 
tion by encoding the audio data Is increasing. Among 
the digital audio data encoding schemes, the MPEG au- is 
dio (Moving Picture Expert Group, Audio Part) is adopt- 
ed widely partly because its standard is open to the put)- 
lic. Using the audio data encoding technique enables 
the reduction of the memory capacity for storing audio 
data. The MPEG audio includes layer-1 , layer-2 and lay- 20 
er-3, and recently, portable digital audio systems which 
reproduce audio data by using the encoding scheme of 
layer-3 (also called MP3) have been put on the market. 
[0003] Digital audio systems which adopt the MPEG 
audio operate to store audio data which is coded based 25 
on the MPEG audio (i.e., MPEG audio data) in the in- 
temal memory, and decode the data with the MPEG au- 
dio decoder on a real-time basis at the time of audio 
reproduction. The decoder can be a special hardware- 
based device, or in many case. It is designed In the form 30 
of program so as to deal with the alteration of the stand- 
ard of decoding. The decoded audio data is converted 
into an analog signal and fed to a headphone or the like, 
or released intact in the form of digital data. MPEG audio 
data to be stored in the memory is downloaded from a 35 
downloading audio terminal unit for delivering audio da- 
ta which is coded based on the MPEG audio, or, in case 
the system has the recording function, it is encoded with 
an MPEG audio encoder which deals with input non- 
compressed audio data. 40 
[0004] Duplication of audio data with these digital au- 
dio systems take place as follows for example. A first 
digital audio unit reads output from its memory and de- 
codes the MPEG audio data with the MPEG audio de- 
coder and transfers the resulting non-compressed audio 
data to a second digital audio unit. The second digital 
audio unit encodes the received audio data based on 
the MPEG audio and stores the resulting MPEG audio 
data in its memory. Duplication of MPEG audio data by 
direct transfer from the memory of the first digital audio so 
unit to the memory of the second digital audio unit is 
generally prohibited by the copyright protection law. 
[0005] In case the copyright Information Is treated in 
the form of electronic watermaric (signature), the first 
digital audio unit once decodes the MPEG audio data in ss 
the memory with the MPEG audio decoder and encodes 
the electronic signature information with the encoder on- 
to the decoded audio data. The second digital audio unit 



decodes the electronic signature information included 
in the input audio data with the signature decoder there- 
by to confimn the permission of re-encoding based on 
the electronic signature information, and then encodes 
the MPEG audio data with the MPEG audio encoder and 
stores in the memory. 

[0006] In the case of altering the electronic signature 
infomiation within one digital audio unit, it once decodes 
the MPEG audio data in the memory with the MPEG au- 
dio decoder, and further decodes the electronic signa- 
ture information included in the audio data with the sig- 
nature decoder. Following the intended alteration of the 
decoded electronic signature infomfiation, e.g.. up- 
counting of the number of times of copying, the signa- 
ture encoder appends the electronic signature informa- 
tion to the audio data, and the MPEG audio encoder en- 
codes the audio data and stores the resulting MPEG au- 
dio data in the memory. 

[0007] The encoding process based on the MPEG au- 
dio first segments the input audio data into frames of a 
certain length, implements the sub-band encoding for 
each frame of audio data, detemiines the bit allotment 
infomiation for each sub-band in accordance with a psy- 
chological audition model, quantizes each sut>-band 
frame data in accordance with the bit allotment informa- 
tion to form sub-band waveform data, and encodes the 
waveform data. Coding parameters including the bit al- 
lotment information, which determine the sound quality 
of the coded MPEG audio data, are different in algorithm 
of detenrtinatlon depending on individual encoders, and 
therefore encoding the same audio data with different 
encoders will not necessarily result in the same coding 
parameters. Determination of coding parameters ne- 
cessitates a huge computation volume, and some en- 
coders designed to have a reduced computation volume 
may not be capable of computing the optimal coding pa- 
rameters. 

[0008] Therefore, when the above-mentioned decod- 
ing-encoding process based on the MPEG audio is per- 
formed, the coding parameters determined by the en- 
coder on the part of the recording unit do not coincide 
with the coding parameters of the original MPEG audio 
data in many cases. In consequence, coding en-ors will 
arise aftenA/ard, giving rise to a problem of deteriorated 
re-encoded sound quality. Particulariy, the inventors of 
the present invention have revealed that if the frame bor- 
ders at re-encoding vary from those of original encoding, 
the encoding result changes significantly to aggravate 
the degraded sound quality. 

[0009] Since the sound quality is mostly detemiined 
by the algorithm of encoding, when MPEG audio data 
is down-loaded from a down-loading audio temiinal unit, 
it is coded based on the optimal adjustment of coding 
parameters by the supplier of MPEG audio data in many 
cases for the sake of the higher sound quality. Whereas, 
real-time encoders equipped in usual audio units, do not 
reach that optimized coding parameters due to the lim- 
ited circuit scale or processing ability. On this account. 
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when audio data down-loaded from a downloading ter- 
minal is subjected to the decoding and re-encoding 
processes, the sound quality is deteriorated significant- 
ly. The encoding process necessitates a huge compu- 
tation volume for the determination of coding parame- 
ters as compared with the decoding process, and there 
emerges another problem of a degraded processing 
speed in the case of implementing the decoding and re- 
encoding processes within the same unit. 
[0010] The inventors of the present invention have 
searched for prior arts after the completion of the inven- 
tion, and found the following publications. Japanese 
Patent Unexamined Publications Nos. Kiel 4(1992)- 
230184 and Hei 4(1992)-358482 describe techniques 
of the dubbing process of VTR, in which control infor- 
mation indicative of encoding/decoding being proc- 
essed or not is released together with the image infor- 
mation signal, and, in the case of "processed", a factor 
signal indicative of the factor used at the process Is re- 
leased, and the image information signal is dubbed by 
encoding it by use of the factor signal. 
[001 1] Japanese Patent Unexamined Publication No. 
Hei 8(1996)-1 68040 describes a technique of the dub- 
bing of reproduced video and audio signals, in which In- 
formation on the quantization for code compression is 
released together with the reproduced signals, and the 
quantization information is used at the quantizing proc- 
ess for code compression by the recording unit. 
[0012] However, these prior art publications do not 
mention the alleviation or prevention of the decay of 
sound quality at copying coded audio data through the 
decoding and encoding processes. 
[001 3] An object of the present Invention is to provide 
a digital audio system which is capable of alleviating the 
decay of sound quality at the decoding and re-encoding 
processes of coded digital audio data, and also capable 
of reducing the computation process for re-encoding. 
[0014] These and other objects and novel features of 
the present invention will become apparent from the fol- 
lowing description taken in conjunction with the accom- 
panying drawings. 

[001 5] Among the affairs of the present invention dis- 
closed in this specification, representatives are briefed 
as follows. 

[0016] (1) A digital audio unit has its audio decoder 
adapted to get coding parameters, which includes at 
least Information of frame borders of coded digital audio 
data, at the decoding of the audio data and release the 
decoded digital audio data and coding parameters. A 
receiving digital audio unit which receives the released 
digital audio data and coding parameters has its audio 
encoder adapted to use the coding parameters at the 
re-encoding of the digital audio data. Consequently, by 
decoding the coded digital audio data and next re-en- 
coding it, a copy of the coded digital audio data is pro- 
duced in an indirect manner. The re-encoding process 
uses the same coding parameters as those used at the 
coding of the original coded digital audio data, and 



therefore the alleviation of the decay of sound quality 
due to re-encoding can be expected. Specifically, re-en- 
coding by use of the coding parameters which have 
been provided for the original coding reduces coding er- 

5 rors, thereby alleviating the decay of sound quality. Par- 
ticulariy, encoding at the same positions of frame parti- 
tion as those of original coding readily achieves the 
same result of high-grade or highly optimized coding, 
and the reduction of coding errors can be expected. 

10 [001 7] In case the original audio data has been coded 
by being highly optimized, re-encoding by use of the ob- 
tained coding parameters Is effective significantly since 
it is difficult for the real-time encoder equipped in the 
audio unit to carry out the optimization at the same level 

15 due to its limited processing ability. In case, as in the 
case of MPEG audio, the coded digital audio data is 
fomied based on sub-band encoding for the audio data 
which is segmented into frames of a certain length, de- 
termination of bit allotment information for each sub- 

20 band in accordance with a psychological audition mod- 
el, quantization of each sub-band in accordance with the 
bit allotment infonmation thereby to form the sub-band 
wavefonm data, it is possible by having the bit allotment 
information included in the coding parameters to use at 

25 the time of re-encoding the same coding parameters as 
the original ones without the need of having the same 
bit allotting algorithm as of the time of coding, and, in 
addition, it is possible to eliminate the computation for 
obtaining the coding parameters. Since determination 

30 of coding parameters takes up a large part of the encod- 
ing process, the elimination of this process achieves the 
reduction of computation volume. At the time of re-en- 
coding, the computation for obtaining coding parame- 
ters is not needed, and consequently the reduction of 

35 computation volume at re-encoding and the speed-up 
of re-encoding process can be accomplished. 
[0018] The audio system may include a multiplexing 
circuit so that the coding parameters are multiplexed to 
the digital audio data released by the audio decoder and 

40 the multiplexed signal is released. The audio encoder 
of the receiving unit is provided at its firont stage with a 
detecting circuit which extracts the coding parameters, 
which are supplied by being multiplexed with the digital 
audio data, and feeds it to the audio encoder. Conse- 

45 quently. the audio data interface temninals can be used, 
instead of needing special terminals, for transferring the 
coding parameters between the units of the digital audio 
system. 

[0019] For the convenience of the management of 
50 copyright matter, the audio system may include a signa- 
ture encoder which appends the electronic signature in- 
formation to the digital audio data released by the audio 
decoder. The receiving unit is provided at the front stage 
of the audio encoder with a signature decoder which ex- 
55 tracts the electronic signature information from the re- 
ceived audio data. Consequently, it is possible to re-en- 
code audio data upon confinming the permission indi- 
cate by the electronic signature information. 
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[0020] (2) A digital audio unit is designed to alter the 
electronic signature information within It. The unit in- 
cludes an audio decoder which decodes coded digital 
audio data, which has been coded by being segmented 
into frames, a signature decoder which extracts etec- 5 
tronic signature Infonmation appended to the digital au- 
dio data released by the audio decoder, a data process- 
ing circuit which alters the extracted electronic signature 
information, a signature encoder which appends the al- 
tered electronic signature information to the digital audio io 
data, and an audio encoder which encodes the digital 
audio data received via the signature encoder. The au- 
dio decoder decodes the coded digital audio data and 
also releases coding parameters Including at least In- 
formation indicative of positions of frame partition of the 15 
digital audio data. The audio encoder encodes the dig- 
ital audio data by using the coding parameters released 
by the audio decoder. 

Consequently, the decay of sound quality can be pre- 
vented or alleviated even in the case of altering or ap- 20 
pending the electronic signature information within the 
digital audio unit. 

IN THE DRAWINGS: 

25 

[0021] 

Fig. 1 is a block diagram showing a first example of 
the inventive digital audio system which is config- 
ured to have the ability of re-encoding; 30 
Fig. 2 Is a diagram showing conceptually the former 
part of the encoding process by the encoding 
scheme of MPEG layer-2 based on the MPEG au- 
dio; 

Fig. 3 is a diagram showing conceptually the latter 35 
part of the encoding process by the encoding 
scheme of MPEG layer-2 based on the MPEG au- 
dio; 

Fig. 4 is a block diagram showing an example of the 
MPEG audio encoder; 40 
Fig. 5 Is a block diagram showing an example of the 
MPEG audio decoder; 

Fig. 6 is a block diagram showing a second example 
of the inventive digital audio system which is con- 
figured to have the ability of re-encoding; <5 
Fig. 7 is a diagram showing an example of the PGM 
audio data, MPEG audio data and multiplexed au- 
dio data processed by the system shown in Fig. 6; 
Fig. 8 is a diagram showing another example of the 
PCM audio data, MPEG audio data and multiplexed 50 
audio data processed by the system shown in Fig. 
6; 

Fig. 9 is a block diagram showing a third example 
of the inventive digital audio system which is con- 
figured to have the ability of re-encoding while being 55 
adapted to deal with the copyright Infomiatlon 
based on the electronic signature; 
Fig. 1 0 is a block diagram showing a fourth example 



of the inventive digital audio system which is con- 
figured to have the ability of re-encoding while being 
adapted to deal with the copyright infomiatlon 
based on the electronic signature; 
Fig. 11 is a block diagram showing a fourth example 
of the inventive digital audio system which is con- 
figured to deal with the alteration of electronic sig- 
nature within the system; 

Fig. 12 is a block diagram showing a variant exam- 
ple derived from the digital audio system of Fig. 1 ; 
Fig. 13 is a block diagram showing another variant 
example derived from the digital audio system of 
Fig. 1; 

Fig. 14 is a block diagram showing a variant exam- 
ple derived from the digital audio system of Fig. 6; 
Fig. 15 is a block diagram showing another variant 
example derived from the digital audio system of 
Fig. 6; 

Fig. 16 is a block diagram showing a variant exam- 
ple derived from the digital audio system of Fig. 9; 
Fig. 17 is a block diagram showing another variant 
example derived from the digital audio system of 
Fig. 9; 

Fig. 18 is a block diagram showing a variant exam- 
ple derived from the digital audio system of Fig. 10; 
Fig. 19 is a block diagram showing another variant 
example derived from the digital audio system of 
Fig. 10; and 

Fig. 20 is a block diagram showing a variant exam- 
ple derived from the digital audio system of Fig. 11 . 

1. Parallel output of coding parameters 

[0022] Fig. 1 shows an example of the inventive digital 
audio system which is configured to have the ability of 
re-encoding. A first digital audio unit 1 includes chiefly 
a memory 10 which can store MPEG audio data and an 
MPEG audio decoder 11. A second digital audio unit 2 
includes chiefly an MPEG audio encoder 22 and a mem- 
ory 20 which can store MPEG audio data. 
[0023] The MPEG audio data stored in the memory 
10 is decoded by the PCM audio decoder 11. and re- 
sulting digital audio data 15 in the form of PCM (pulse 
code modulation), for example, is released from the unit 
1 . In this operation, the MPEG audio decoder 1 1 , which 
recognizes coding parameters used for the coding of the 
MPEG audio data stored in the memory 10, releases 
them as coding parameters 14. The coding parameters 
14 include frame border information (indicative of the 
position of frame partition of the decoded PCM audio 
data) and bit allotment information. 
[0024] The digital audio unit 2 receives the PCM audio 
data 15 and coding parameters 14, operates on the 
MPEG audio encoder 22 to re-encode the PCM audio 
data 15 by using the received coding parameters 14, 
and stores the encoded MPEG audio data In the mem- 
ory 20. 

[0025] Accordingly, the digital audio units 1 and 2 
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have their MPEG audio data in their memories 10 and 
20 coded by the same coding parameters, and conse- 
quently, the decay of sound quality at re-encoding by 
the MPEG audio encoder 22 can be alleviated. 
[0026] Particulariy, in case the MPEG audio data in 
the memory 1 0 of the digital audio unit 1 has been down- 
loaded from a down-loading temninal unit by being cod- 
ed with the rendition of high-grade optimization and the 
digital audio unit 2 re-encodes the received audio data 
by using coding parameters different from those for cod- 
ing, the decay of sound quality is inevitable, whereas by 
transferring the coding parameters from the encoding 
unit 1 to the decoding unit 2 as shown in Fig. 1 , it be- 
comes possible for the MPEG audio encoder 22 of the 
digital audio unit 2 to use the same coding parameters 
as those used for coding by the down-loading tenninal 
unit. In consequence, it becomes possible to prevent or 
alleviate the decay of sound quality particulariy at re- 
enooding. Moreover, the MPEG audio encoder 22 of the 
digital audio unit 2 does not need to compute coding pa- 
rameters, and the reduction of power consumption of 
the unit 2 can be expected. 

[0027] The encoding scheme of MPEG layer-2, as an 
example of encoding schemes based on the MPEG au- 
dio, will be explained with reference to Fig. 2 and Fig. 3. 
PCM audio data which is depicted as shown by (A) in 
Fig. 2 is segmented into frames each including 1152 
samples as shown by (B), and each frame is further di- 
vided into 32 sub-bands of frequencies as shown by (C) 
in Fig. 2. Each sub-band is rendered the bit allotment 
based on a psychological audition model (adaptive bit 
allotment) as shown by (D) in Fig. 3, 
[0028] The psychological audition model is produced 
by computation from the audient characteristics of hu- 
man ears and sound components which are inaudible 
due to masking or the tike in the frequency or time do- 
main. Based on this computation, sub-bands which are 
completely needless in terms of audition are given no 
bit, and sub-bands which can be quantized coarsely 
without creating audible noises are given fewer bits. Bit 
allotment is implemented so that the decay of sound 
quality is minimized in terms of audition on condition that 
the code size of a frame does not exceed the specified 
number of bits (determined from the bit rate. etc.). The 
nature of bit allotment dominates the grade of sound 
quality. In the example shown by (D) in Fig. 3, sub-band 
#22 and the above are given no bit allotment. 
[0029] The audio data converted to the sub-bands of 
frequency domain is quantized in the numbers of bits 
allotted by adaptive bit allotment as shown by (E) in Fig. 
3. In the quantizing process, the data size of sub-band 
is evaluated in terms of a scale factor, and each sub- 
band is expressed by a scale factor and a normalized 
waveform. Specifically, multiple sample data in a sut)- 
band are separated into a waveform which is normalized 
to have a peak value of 1.0 and a magnification factor, 
i.e., scale factor. 

[0030] Finally, a code Is produced from these data as 
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shown by (F) in Fig. 3. Coded data of each frame begins 
with a 4-byte header. The header has Its leading 12 bits 
fixed to logic "1 and the MPEG audio decoder decodes 
a coded frame which begins with the 12 bits of "1". The 
5 header further includes information on the sampling fre- 
quency of PCM digital audio and the presence or ab- 
sence of CRC. by which Infomiation the byte length of 
a coded frame can be calculated. The header of MPEG 
audio data of a coded frame is followed by the bit allot- 
to ment information, scale factor and sub-band waveform 
samples. 

[0031] Fig. 4 shows an example of the MPEG audio 
encoder 22. The MPEG audio encoder 22, which is de- 
signed to carry out encoding based on the MPEG audio 
15 explained in connection with Fig. 2 and Fig. 3, includes 
a framing circuit 30, a filter bank 31 , a quantizer 32, a 
psychological audition model generation circuit 33, a dy- 
namic bit allotting circuit 34, and a code forming circuit 
35. 

20 [0032] In case the MPEG audio encoder 22 is sup- 
plied with coding parameters 14 together with PCM au- 
dio data 15, frame border information 14A included in 
the coding parameters 14 is given to the framing circuit 
30 and bit allotment infonmation 1 4B included in the cod- 

25 ing parameters 1 4 is given to the quantizer 32 and code 
forming circuit 35 by way of a selector switch circuit 36, 
and the psychological audition model generation circuit 

33 and dynamic bit allotting circuit 34 do not need to 
operate. 

30 [0033] The input PCM audio data 1 5 is first segment- 
ed into frames by the framing circuit 30, and In case it 
has the supply of the coding parameters 14 correspond- 
ing to the PCM audio data 15, it determines frame bor- 
ders by using the firame border information 14A included 

35 in the coding parameters 14. For example, it starts to 
make a frame of 1152 samples when the firame border 
infomiation 14A which is synchronous with the Input 
PCM audio data 15 turns to T. 
[0034] The filter bank 31 , quantizer 32, code forming 

40 circuit 35, psychological audition model generation cir- 
cuit 33, and dynamic bit allotting circuit 34 are identical 
to the conventional MPEG encoder which is designed 
to have no input of coding parameters 14. The firamed 
audio data is first converted into frequency bands by the 

45 filter bank 31 . The data of frequency domain is quan- 
tized by the quantizer 32. and next encoded to have the 
format of MPEG audio data by the code forming circuit 
35. 

[0035] In contrast to the conventional MPEG encoder 
50 in which the amount of bit allotment to each frequency 
band is determined by the dynamic bit allotting circuit 

34 based on the psychological audition model provided 
by the psychological audition model generation circuit 
33 and it is indicated to the quantizer 32, the MPEG au- 

55 dio encoder 22 of this embodiment shown in Fig. 4 has 
the bit allotment information 14B included in the coding 
parameters 14 and the quantizer 32 takes in the infor- 
mation 148 to carry out the quantization. 
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[0036] Accordingly, in the case of the system config- 
uration of Fig. 1 which is designed to decode and re- 
encode the MPEG audio data, the psychological audi- 
tion model generation circuit 33 and dynamic bit allotting 
circuit 34 may be absent. OthenA/ise, by the provision of 5 
the psychological audition model generation circuit 33 
and dynamic bit allotting circuit 34 and the addition of 
the switch drcuit 36 which switches route of bit allotment 
information as shown in Fig. 4, the MPEG audio encoder 
22 can also perform in the conventional manner to en- io 
code the PCM audio data which does not include the 
coding parameters. 

[0037] Fig. 5 shows an example of the MPEG audio 
decoder 11. It includes a code purser 40, an inverse 
quantizing circuit 41 , and a filter bank 42. The code purs- ^5 
er 40 receives the MPEG audio data which is formatted 
as shown by (F) in Fig. 3, recognizes the coding format 
based on the header, extracts the bit allotment informa- 
tion, scale factor and sub-band sample data out of each 
infomnation field, and feeds them to the inverse quantiz- 20 
ing circuit 41 . 

[0038] The inverse quantizing circuit 41 implements 
the inverse quantization of the sample data of each sub- 
band in accordance with the provided information, and 
the inverse-quantized data of firequency domain is 25 
tumed back to the PCM audio data 1 5 by the filter bank 
42. In synchronism with the output of PCM audio data, 
the code purser 40 releases the frame partition informa- 
tion 14A and bit allotment information 14B of the PCM 
audio data. The released frame partition infomnation 30 
14A and bit allotment infomiation 14B are derived from 
the infonnation extracted from the coded frame of the 
MPEG audio data which is fed by the purser 40 to the 
inverse quantizing circuit 41 . 

35 

2. Multiplexing of coding parameters 

[0039] Fig. 6 shows the second example of the inven- 
tive digital audio system which is configured to have the 
ability of re-encoding. This system configuration differs <o 
from the preceding one shown in Fig. 1 in that the coding 
parameters are transfen-ed by being multiplexed to the 
PCM audio data. A first digital audio unit 1 A includes a 
multiplexing circuit 12 in addition to the memory 10 and 
MPEG audio decoder 1 1 . A second digital audio unit 2A <5 
includes a parameter detecting circuit 21 in addition to 
the MPEG audio encoder 22 and memory 20. 
[0040] The coding parameters 14 provided by the 
MPEG audio decoder 11 is multiplexed to part of the 
PCM audio data 15 by the multiplexing circuit 12, and so 
the audio unit 1A releases multiplexed audio data 16. 
This multiplexing can be implemented by, for example, 
assigning spare bits of the PCM audio data 15 to the 
coding parameters 14. Alternatively, the coding param- 
eters 1 4 can be appended to the PCM audio data based 55 
on the electronic signature Information embedding tech- 
nique. 

[0041] The multiplexed audio data 16 including the 



coding parameter information can be transferred to the 
second digital audio unit 2A over the usual audio trans- 
fer path. The second digital audio unit 2A operates on 
its parameter detecting circuit 21 to separate the re- 
ceived multiplexed audio data 16 into the PCM audio 
data 15 and coding parameters 14, operates on its 
MPEG audio encoder 22 to encode the PCM audio data 
15. and stores the encoded MPEG audio data in the 
memory 20. 

[0042] Based on this system configuration also, the 
MPEG audio data which is stored in the memory 10 of 
the first digital audio unit 1 A and the MPEG audio data 
which is once decoded and re-encoded and stored in 
the memory 20 of the second digital audio unit 2A are 
encoded based on the same coding parameters, and 
the decay of sound quality at recording by the second 
digital audio unit 2A can be alleviated as in the case of 
the preceding system configuration of Fig. 1 . The usual 
PCM audio data transfer path can be used for data 
transfer from the first digital audio unit 1 A to the second 
digital audio unit 2A. The MPEG audio encoder 22 of 
the second digital audio unit 2A does not need to com- 
pute coding parameters, and the reduction of power 
consumption of the unit 2A can be expected. Moreover, 
the coding parameters can be transacted between the 
digital audio units by use of their interface tenninals of 
PCM audio data, instead of needing special terminals. 
[0043] The first digital audio unit 1 A of Fig . 6 can have 
Its MPEG audio decoder 11 and multiplexing circuit 12 
fbmned in separate LSIs (semiconductor integrated cir- 
cuits), while it is also possible to unify both circuits in a 
special LSI. The special LSI can be either a hardware- 
based device or a CPU (central processing unit) or DSP 
(digital signal processor) having the operation program. 
Similariy, the second digital audio unit 2A can have its 
parameter detecting circuit 21 and MPEG audio encod- 
er 22 fomied in separate LSIs. while it is also possible 
to unify both circuits in one LSI. The LSI can be either 
a hardware-based device or a CPU or DSP having the 
operation program. 

[0044] Fig. 7 shows an example of audio data proc- 
essed by the digital audio system shown in Fig. 6. PCM 
audio data 50 is quantized in 16 bits for each of the right 
and left channels R and L in general. The figure shows 
a 1 6-bit datum in terms of a 4-digit hexadecimal number. 
In this example, the left channel has a first PCM datum 
of 1CAC (hex) and the right channel has a first PCM 
datum of 1 DBF (hex). 

[0045] The MPEG audio encoder segments this PCM 
audio data 50 into frames each including 1152 samples 
and encodes each frame. Coded PCM audio data 17 is 
also In the form of frames each having certain bytes. 
The example shown in Fig. 7 is MPEG audio data having 
a frame length of 384 bytes. The frame length is deter- 
mined uniquely from the bit rate and sampling frequency 
of MPEG audio data. Each frame of MPEG audio data 
has 1 2 leading bits of "1", which are followed by a header 
including infomiation of bit rate and sampling firequency 
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and further followed by coded audio data. 

[0046] The coded MPEG audio data 17 is stored in 

the memory 10 shown in Fig. 6. The MPEG audio de- 
coder 11 operates to decode the MPEG audio data 17 
to release the PCM audio data 1 5. Since the MPEG au- 5 
dio data 1 7 is decoded for each frame, the resulting de- 
coded PCM audio data 15 retains the frame borders. 
Information of frame borders can be transfen-ed by hav- 
ing one of spare bits of PCM data set to "1 " for the sam- 
ple datum at the frame head and "0" for the successive io 
sample data. 

[0047] Fig. 8 shows an example of data of the case of 
transferring the bit allotment information 14B in addition 
to the frame border information 14A. The coding proc- 
ess for the PCM audio data 50 is identical to the case is 
shown in Fig. 7. The MPEG audio decoder 11 decodes 
the MPEG audio data 1 7 to release the PCM audio data 
15. At this time, the bit allotment information 14B, in ad- 
dition to the 1-bit frame border information 14A, is also 
multiplexed to the PCM audio data 1 5 to form the mul- 20 
tiplexed audio data 16. The bit allotment information, 
which indicates the amount of bit allotment to each sub- 
band at MPEG coding, is determined by the MPEG au- 
dio encoder by being adaptive to the PCM data of the 
original sound and appended to the MPEG audio data. 25 
The bit allotment information of the case of MPEG layer- 
2 can be expressed by 4 bits I{ }32!{ }2, and if the 4-bit 
bit allotment information is multiplexed to each sample 
as shown in Fig. 8, i.e.,64 pieces of information is mul- 
tiplexed for the right and left sub-bands, the necessary 30 
bit allotment Information can be multiplexed to the PCM 
audio data by being carried in 64 samples. 

3. Treatment of signature information 

35 

[0048] Fig. 9 shows the third example of the Inventive 
digital audio system which is configured to have the abil- 
ity of re-encoding while being adapted to deal with cop- 
yright information based on the electronic signature. 
This system configuration differs from the preceding one ^ 
shown in Fig. 1 in that the first digital audio unit 1B in- 
cludes a signature encoder 18 and the second digital 
audio unit 28 includes a signature decoder 23. 
[0049] The signature encoder 1 8 has a process of em- 
bedding electronic signature information 51 in the input 45 
source information. The technique of electronic signa- 
ture is to conceal some Information in audio/video data. 
With the invisible electronic signature information being 
embedded and retained somewhere in an electronic 
publication, it is expected to protect the publication from 50 
being copied illegally. The electronic signature infonrna- 
tion to be embedded in source infonmation can be spe- 
cifically an identification (ID) number corresponding to 
the copyright holder, the company which holds the 
wholesale right of the source information, or the audio 55 
data itself. The signature encoder 18 embeds the elec- 
tronic signature information 51 in the PCM audio data 
1 5 of source information in accordance with such an al- 



gorithm that the signature information effectuates 
strongly and is less influential on the source infbnnation. 
[0050] The MPEG audio data stored in the memory 

10 of the first digital audio unit IB is once decoded by 
the MPEG audio decoder 11. and the electronic signa- 
ture information 51 is encoded to the decoded PCM au- 
dio data 15 by the signature encoder 18. In the second 
digital audio unit 2B, the signature decoder 23 separates 
from the PCM audio data 15A the electronic signature 
information 51, which is analyzed by the controller (not 
shown) to check the permission of re-encoding, and the 
MPEG audio encoder 22 encodes the PCM audio data 
15A and stores the resulting MPEG audio data in the 
memory 20 if re-encoding is granted. The encoding 
process uses the coding parameters 14 which are re- 
leased and transferred from the MPEG audio decoder 

11 of the digital audio unit 1B as described previously. 
Based on the system configuration of Fig. 9, it becomes 
possible to determine whether the re-encoding process 
is to proceed depending on the analysis result of the 
electronic signature information. 

[0051] Fig. 1 0 shows the fourth example of the inven- 
tive digital audio system which is configured to have the 
ability of re-encoding while being adapted to deal with 
the copyright information based on the electronic signa- 
ture. This system configuration differs from the preced- 
ing one shown in Fig. 6 in that the first digital audio unit 
1C includes a signature encoder 1 8 and the second dig- 
ital audio unit 2C includes a signature decoder 23. 
[0052] The signature encoder 18 embeds the elec- 
tronic signature infbnnation 51 in the source infonnation 
which is the multiplexed audio data 16 provided by the 
multiplexing circuit 12, and releases the resulting multi- 
plexed audio data 16A. The signature decoder 23 sep- 
arates the multiplexed audio data 1 6A into the electronic 
signature information 51 and multiplexed audio data 16. 
The controller (not shown) analyzes the electronic sig- 
nature information 51 to check the permission of re-en- 
coding, and the parameter detecting circuit 21 sepa- 
rates the multiplexed audio data 16 into the PCM audio 
data 15 and coding parameters 14 if re-encoding is 
granted. The MPEG audio encoder 22 encodes the 
PCM audio data 15 and stores the resulting MPEG au- 
dio data in the memory 20. The encoding process uses 
the coding parameters 14 which are released by the pa- 
rameter detecting circuit 21 . 
[0053] Fig. 11 shows the fifth example of the inventive 
digital audio system which is adapted to alter the elec- 
tronic signature infomnatlon within the system. The 
memory 10 stores coded MPEG audio data, with elec- 
tronic signature information being embedded therein. 
The digital audio unit 3, which is adapted to alter the 
electronic signature information intemally, includes a 
memory 10, an MPEG audio decoder 11, a signature 
decoder 23, a signature encoder 18, an MPEG audio 
encoder 22, a memory 20, and a signature altering dr- 
cuit 52. The coding parameters 14 are fed from the 
MPEG audio decoder 1 1 to the MPEG audio encoder 22. 
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[0054] The MPEG audio decoder 1 1 reads the coded 
MPEG audio data, with the electronic signature informa- 
tion being embedded therein, out of the memory 10 to 
decode the data, and releases the resulting PCM audio 
information 1 5A, with the electronic signature infonna- 5 
tion being embedded therein, and the coding parame- 
ters 14. The signature decoder 23 separates the audio 
information 15A into the PCM audio data 15 and signa- 
ture information 51 A. The signature altering circuit 52 
alters the received electronic signature infonmation 51 A, 10 
e.g., updates the count data of copying, and releases 
the resulting electronic signature Information 51B to the 
signature encoder 18. 

[0055] The signature encoder 18 embeds the elec- 
tronic signature information 51 B in the PCM audio data ^5 
15, and the MPEG audio encoder 22 re-encodes the re- 
sulting audio data 158 to fonm the MPEG audio data by 
using the coding parameters 14 as described previous- 
ly. Since the MPEG audio encoder 22 uses at re-encod- 
ing the coding parameters 14 provided by the MPEG 20 
audio decoder 11, the original MPEG audio data in the 
memory 10 and the re-encoded MPEG audio data in- 
herit the same coding parameters, whereby the decay 
of sound quality is alleviated. The MPEG audio encoder 
22 does not need the computation of coding parameters 25 
at re-encoding, and the speed-up of process and the re- 
duction of power consumption can be expected. Based 
on the system configuration of Fig. 11, it becomes pos- 
sible to prevent or alleviate the decay of sound quality 
in the case of altering or adding the electronic signature 30 
information within the digital audio unit 3. 

4. Variant digital audio systems 

[0056] Variant digital audio systems derived from the 35 
foregoing basic system configurations will be explained. 
[0057] Fig. 12 shows a digital audio unit 4A, which is 
derived from the digital audio unit 1 of Fig. 1 and further 
provided with a D/A converter 60 for converting the PCM 
audio data 1 5 into an analog signal and an interface ter- 40 
minal 62 for introducing MPEG audio data from a down- 
loading temiinal unit 61 , which implements down-load- 
ing of MPEG audio data via a network such as the In- 
ternet, to the memory 10. A controller 63A implements 
the intemal control of the digital audio unit 4A. ^5 
[0058] Fig. 1 3 shows a digital audio unit 4B, which is 
derived from the digital audio unit 4A of Fig. 1 2 and fur- 
ther provided with an MPEG audio encoder 22 which 
enables the reception of the PCM audio data 15 and 
coding parameters 14, so that the output of the MPEG 50 
audio encoder 22 or the input audio data from the ter- 
minal 62 is stored in the memory 10 by being selected 
by a switch 64. A controller 63B implements the intemal 
control of the digital audio unit 48, e.g.. it operates the 
switch 64 depending on the operational mode specified 55 
by an extemal signal. The digital audio unit 48 of Fig. 
1 3 has both functions of the units 1 and 2 shown in Fig. 1 . 
[0059] Fig. 14 shows a digital audio unit 5A, which is 



derived from the digital audio unit 1 A of Fig. 6 and further 
provided with a D/A converter 60 for converting the PCM 
audio data 1 5, with the coding parameters 14 being mul- 
tiplexed thereto, into an analog signal and an interface 
terminal 62 for introducing MPEG audio data from a 
down-loading terminal unit 61. A controller 63C imple- 
ments the intemal control of the digital audio unit 5A. 
[0060] Fig. 15 shows a digital audio unit 58, which is 
derived from the digital audio unit 5A of Fig. 14 and fur- 
ther provided with a parameter detecting drcuit 21 and 
an MPEG audio encoder 22. The parameter detecting 
circuit 21, which receives the PCM audio data 15, with 
the coding parameters 14 being multiplexed thereto, 
separates the input multiplexed audio data 16 into the 
PCM audio data 15 and coding parameters 14. The 
MPEG audio encoder 22 encodes the separated PCM 
audio data 15 by using the coding parameters 14. The 
output of the MPEG audio encoder 22 or the input audio 
data from the terminal 62 is stored in the memory 10 by 
being selected by a switch 64. A controller 63D imple- 
ments the intemal control of the digital audio unit 58. 
The digital audio unit 58 of Fig. 1 5 has both functions of 
the units 1 A and 2A shown in Fig. 6. 
[0061] Fig. 16 shows a digital audio unit 6A, which is 
derived from the digital audio unit 1 8 of Fig . 9 and further 
provided with a D/A converter 60 for converting the PCM 
audio data 15A, with the signature information 51 being 
embedded therein, into an analog signal and an inter- 
face terminal 62 for introducing MPEG audio data from 
a down-loading terminal unit 61 . A controller 63E imple- 
ments the intemal control of the digital audio unit 6A. 
[0062] Fig. 17 shows a digital audio unit 68, which is 
derived from the digital audio unit 6A of Fig. 16 and fur- 
ther provided with a signature decoder 23 and an MPEG 
audio encoder 22. The signature decoder 23, which re- 
ceives the PCM audio data 15A, with the signature in- 
fonmation being embedded therein, separates the input 
audio data 15A into the PCM audio data 15 and signa- 
ture information 51 . The MPEG audio encoder 22 en- 
codes the separated PCM audio data 15 by using the 
coding parameters 14. The output of the MPEG audio 
encoder 22 or input audio data from the terminal 62 is 
stored in the memory 10 by being selected by a switch 
64. A controller 63F implements the intemal control of 
the digital audio unit 6B. The digital audio unit 68 of Fig. 
17 has both functions of the units IB and 28 shown in 
Fig. 9. 

[0063] Fig. 18 shows a digital audio unit 7A, which is 
derived from the digital audio unit 1C of Fig, 10 and fur- 
ther provided with a D/A converter 60 for converting the 
PCM audio data 16A, with the signature infomnation 51 
being embedded therein, into an analog signal and an 
internee terminal 62 for introducing MPEG audio data 
from a down-loading tenminal unit 61. A controller 63G 
implements the intemal control of the digital audio unit 
7A. 

[0064] Fig. 19 shows a digital audio unit 78, which is 
derived from the digital audio unit 6A of Fig. 18 and fur- 
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ther provided with a signature decoder 23, a parameter 
detecting circuit 21 and an MPEG audio encoder 22. 
The signature decoder 23, which receives the audio da- 
ta 16A, with the coding parameters being multiplexed 
thereto and the signature infonnation being embedded s 
therein, separates the input audio data 16A into the 
PCM audio data 16, with the coding parameters being 
multiplexed thereto, and the signature information 51 . 
The parameter detecting circuit 21 separates the multi- 
plexed audio data 16 into the PCM audio data 15 and 
coding parameters 14. The MPEG audio encoder 22 en- 
codes the separated PCM audio data 15 by using the 
coding parameters 14. The output of the MPEG audio 
encoder 22 or input audio data from the terminal 62 is 
stored in the memory 10 by being selected by a switch 
64. A controller 631-1 implements the intemal control of 
the digital audio unit 7B. The digital audio unit 7B of Fig. 

19 has both functions of the units 1C and 2C shown in 
Fig. 10. 

[0065] Fig. 20 shows a digital audio unit 8, which is 
derived from the digital audio unit3of Fig. 11 and further 
provided with a D/A converter 60 for converting the PCM 
audio data 15 released by the MPEG audio decoder 11 
into an analog signal and an interface terminal 62 for 
introducing MPEG audio data from a down-loading ter- 
minal unit 61 . A controller 65 implements the intemal 
control of the digital audio unit 8. 
[0066] Although the present invention has been ex- 
plained specifically in connection with the embodiments, 
the present invention is not confined to these embodi- 
ments, but various alterations are obviously possible 
without departing from the essence of the invention. 
[0067] For example, the memories 1 0 and 20 can be 
memory devices fixed on the circuit boards of the digital 
audio units, or can be memory cards which are put in 
and out of the units. In the latter case, the memory cards 
can be PC flash memory cards, compact flash memory 
cards, or multi-media cards. In case the memories 1 0 
and 20 are non-volatile memories, they are not confined 
to be flash memories, but can be ferrodielectric memo- 
ries or SRAMs having backup power sources. 
[0068] The digital audio units shown in Fig. 1 , Fig, 6, 
Fig. 9 and Fig. 11 include their own controllers, although 
these are not shown. For example, in case the MPEG 
audio decoder 11 and multiplexing circuit 12 of Fig. 6 
are formed of a CPU, DSP and operation programs, the 
controller can be formed of the CPU and an operation 
program. The controllers shown in Fig. 12 through Fig. 

20 can also be formed of CPUs and operation programs. 
[0069] The coding parameters include at least infor- 
mation indicative of frame borders of digital audio data. 
Other coding parameters, which depend on the encod- 
ing scheme, can be for example the bit allotment infor- 
mation described previously in the case of using the en- 
coding scheme of MPEG layer-2. 
[0070] The encoding scheme for digital audio data is 
not confined to the MPEG audio, but it can obviously be 
other existing compressing scheme or a counterpart 



which will be available in the future. Audio data include 
vocal infonnation obviously. 
[0071] The effectiveness achieved by the present in- 
vention is briefed as follows. 

[0072] Digital audio data which is decoded once is re- 
encoded by use of the same coding parameters as 
those used for coding the original digital audio data, and 
the decay of sound quality at re-encoding can be allevi- 
ated. Specifically, using the coding parameters which 
have been used for original coding reduces coding er- 
rors, thereby alleviating the decay of sound quality. Par- 
ticulariy, encoding at the same positions of frame parti- 
tion as those of original coding readily achieves the 
same result of high-grade or highly optimized coding, 
and the reduction of coding errors can be expected. 
[0073] In case, as in the case of the MPEG audio, the 
coded digital audio data is produced based on sub-band 
encoding for the audio data which is segmented into 
frames of a certain length, determination of bit allotment 
infonnation for each sub-band in accordance with a psy- 
chological audition model, quantization of each sub- 
band in accordance with the bit allotment Infonmation 
thereby to form sub-band waveform data, it is possible 
by having the bit allotment infonmation included in the 
coding parameters to use at re-encoding the same cod- 
ing parameters as the original ones without the need of 
having the same bit allotting algorithm as of original cod- 
ing, and, in addition, it is possible to eliminate the com- 
putation for obtaining coding parameters. 
[0074] Since the coding parameter determination 
takes up a large part of the encoding process, the elim- 
ination of this process achieves the reduction of compu- 
tation volume. At the time of re-encoding, the computa- 
tion for obtaining coding parameters is not needed, and 
consequently the reduction of computation volume at re- 
encoding and the speed-up of the re-encoding process 
can be accomplished. 

[0075] Also in the case of altering or adding electronic 
signature infonnation for digital audio data which is cod- 
ed, with electronic signature information being embed- 
ded therein, it is readily possible to prevent or alleviate 
the decay of sound quality. 



Claims 

1 . A digital audio system including: 

an audio decoder for decoding coded digital au- 
dio data which is coded by being segmented 
into frames, 

said audio decoder being capable of outputting 
digital audio data, which results from decoding 
of the coded digital audio data, and coding pa- 
rameters which include at least information in- 
dicative of positions of frame partition of the dig- 
ital audio data. 
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A digital audio system including: 

an audio decoder for decoding coded digital au- 
dio data which is coded by being segmented 
into frames; and 5 
an audio encoder for encoding digital audio da- 
ta, 

said audio encoder receiving the decoded dig- 
ital audio data and coding parameters which In- 
clude at least infomfiation indicative of positions 
of frame partition of the digital audio data and 
being capable of encoding the received digital 
audio data by using the coding parameters to 
form coded digital audio data. 

15 

A digital audio system including: 

an audio decoder for decoding coded digital au- 
dio data which Is coded by being segmented 
into frames; 20 
an audio encoder for encoding digital audio da- 
ta; and 
a memory. 

said audio decoder being capable of releasing 
digital audio data, which results from decoding 25 
of the coded digital audio data, and coding pa- 
rameters which include at least infonmation in- 
dicative of positions of frame partition of the dig- 
ital audio data. 

said audio encoder receiving the digital audio 30 
data and the coding parameters and being ca- 
pable of encoding the received digital audio da- 
ta by using the coding parameters and releas- 
ing the encoded digital audio data, 
said memory being capable of storing the en- 35 
coded digital audio data released by said audio 
encoder. 

A digital audio system according to claim 3 further 
including a multiplexing circuit for multiplexing the ^ 
decoded digital audio data and coding parameters 
released by said audio decoder and releasing the 
multiplexed digital audio data. 

A digital audio system according to claim 4 further ^5 
including a detection circuit for extracting the coding 
parameters from the multiplexed digital audio data 
and feeding to said audio encoder. 

A digital audio system according to claim 1 further 50 
including a signature encoder for embedding elec- 
tronic signature information In the digital audio data 
released by said audio decoder. 

A digital audio system according to claim 2 further 55 
including a signature decoder for extracting elec- 
tronic signature information embedded in the input 
digital audio data. 



8. A digital audio system including: 

an audio decoder for decoding coded digital au- 
dio data which is coded by being segmented 
into frames; 

a signature decoder for extracting electronic 
signature infonmation embedded in the digital 
audio data released by said audio decoder; 
a data processing circuit for altering the extract- 
ed electronic signature information; 
a signature encoder for embedding the elec- 
tronic signature information altered by said da- 
ta processing circuit in the digital audio data 
and releasing the resulting digital audio data; 
and 

an audio encoder for encoding the digital audio 
data supplied through said signature encoder, 
said audio decoder being capable of releasing 
digital audio data, which results from decoding 
of the coded digital audio data, and coding pa- 
rameters which include at least information in- 
dicative of positions of frame partition of the dig- 
ital audio data. 

said audio encoder being capable of encoding 
the digital audio data by using the coding pa- 
rameters released by said audio encoder. 

9. A digital audio system according to claim 1 . wherein 
said digital audio data comprises PCM data and 
said coded digital audio data comprises MPEG au- 
dio data including a header, bit allotment informa- 
tion for the allotment of bits to each sub-band in ac- 
cordance with an audition model, and sub-band 
waveform data resulting from quantization of each 
sub-band in accordance with the bit allotment infor- 
mation. 

10. A digital audio system according to claim 9, wherein 
said coding parameters include information, which 
indicates position of frame partition created based 
on the header, and the bit allotment information. 
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FIG. 2 
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FIG. 3 



3. BIT ALLOTMENT 
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FIG. 4 
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